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(54) Color separating cfiffractive optical arn^ 



(57) In one embodimient a diffractive element hav- 
ing at least one surface formed as a plurality of blazed 
diffractive features that are curved ahd decentered to 
focus and cfinomattcany disperse inddent light istto Red, 
Green, and Blue spots. An array of the diffractive ( 



ments is disclosed for separating incident Oght fiom a 
color image to form Red. Green, and Blue, separations 
of the image without tie use of filters. 
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Description 

Reid of Invention 

5 The present invention relates to the field of color separation fbr use with a monochrome CCD or photodiode ansy. 
Background of the Invention 

When utilizing CCD or photodiode arrays as electronic image sensors In scanners and cameras to form color 
10 images of a scene, the light incident on the photosensitive elements fornrting the CCD or the photodiode array must be 
separated into three dolor channels (red. green. k)lue or cyaa magenta, yellow)- This Is due to the fact that CCDs and 
photodiode arrays have k>roadband sensitivity, therefore any color selectivity is typically due to a filter b^hg placed in 
the light patii before the photosensitive elements. This can be accomplished by forming fOters on top of the photosen- 
sttive elements or by using a filter wheel in front of a lens to form three sequentially filtered images of the scene. Wheii 
IS utilizing a f ilt^ some traction of the tncident light is lost in order to aflow only tiie odor of interest onto the photosensitive 
elements. This forc^ the'use of a relatively low F/# (high numerical aperture) lens in order to capture enough light to 
form a high quality imaga 

Another feature of electronic irhagir^ sensors is tfiat they typically have some anpfifying and read out electronics, 
formed nearby so tfie area of tfie photos&isrtive elem^ is less than the area of the unit cell in which it resides (there 

20 is a non-photosensitive area arbund ttie element): Directing light from the non-photosensitive cU'eas onto the photosen- 
sitive areas increases the Gght gathering efTidehcy of the sensor. Prior art techniques have used refiractive concentrator 
lenses formed on the CCD array to concentrate li^ which would otheravise be Incident on the non-photosensitive areas 
of the sensor onto tiie photosensitive areas. " . 

When digitally sanpled images are made with lenses which have resolutions which are higher than ttie Nyqulst fre- 

2s quency of the sensor (1^ the sampling spatial frequency) and the anrangeiiiient of the color pixels is uniform, high spa- 
tial frequency objects can appear to have h^ frequency cplof bands moving across them 6ae to the spatial detail of 
the image, which is beydnd tiie sensor's Nyqpist frequency. This phenomena is known as aliasing In the digital image 
processing field. Aliasirig is typically eitiier tolerated or minimized by using an anti-aliasing birefringent blur fitter formed 
witti two quartz plates. This type of ahti-aliasihg filter aeates four spots from one original spot and thereby reduces 

30 sharpness to tfie point where aliasing is not obsenred. However, tiiis also causes reduced contrast at frequencies below 
the Nyquist frequency. 

In U.S. Patent Na 4.994,664. entitied "Optically Coupled Focal Plane Anays Using Lenslets and Multiplexers" by 
W. B. Veldkamp. there is disclosed the use of an anay of ooncentrfo diffractive lenses as a concentrator. Each concen- 
tric lens is located directly over a con;esponding photosensitive element and concentrates light onto the photosensitive 
35 site which increases the light gatiiering ability of tfie sofid state imaging device. This lens anrangement does not allow 
for cofor separation of the concentrated light or achieve a reduction in aliasing. Each off the lenses Is fonned as a rota- 
tioruUly synvnetrical element which inh33its their use as a color iseparating element and prevents the conrection of off- 
euds aberrations with asymmetric diffractive coeffi^ 

Anottier piece of prior art of Interest is U. S. Patent fto. 5,340.978; ehtitied» "Image-Sensing Display Panels Witti 
40 LCD Display Panel and Photosensitive Element Array" by Rostoker et al:; wherein in Rg. 8 there is disclosed an anr^ 
^ ^ of circular elements 808 which are used to separate Inctderit light into red, green and blue components and to focus the 
components onto one of ttiree photosensois 802a. 802b^ or 802a The arrangement shown does not efTicienfly utilize 
all of tfie incident light in that light frequencies falling l>etween tiie ttiree components will not t>e deflected to one of ttie 
photosensors and will ttierefore be lost The lens elements described are decentered. rotationally symmetric diffractive 
46 elements which do not provide ttie same degree of aberration con-ection as an asymmetric diffractive element Furttier- 
' more, the invention does not disclose the iise diffractive elements for the minimization of aliasing. 

Neitiier of ttie referenced patente disclose a technique for dompensating for the variation in angular subtense of a 
giveri color as a function of field angle. This variation would cause a sftifl in color balance and a change in tfie integrated 
intensity of tfie sensor array as a function of field angle witti field angle being defined as ttie angle from ttie optical axis 
so of ttie camera or scanner lens. 

There Is also no discussion of ttie location of CCD pixels across tiie array in the (firection of tfie linear grating term 
as a function of the field angle to compensate for ttie change of cGffraction angle as a function of the angle of indd&ioe. 

Summyy of |hg Iriventfon 

The present invention is directed to overcoming one or wore of ttie prot)lems set fortti above. Briefly summarized, 
according to one aspect of the present invention there is provided a diffractive element havirig at least one surface 
formed as a plurality of blazed diffractive features that are curved so as to focus and chromatically disperse incident 
light 
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The invention consists of utilizing an array of diffractive elements with focusing and dispersive conponents to con- 
centrate and disperse incident light into its compofient colors onto a CCD array without the need for an absorption filter 
over each element (see Rgure 1 ). Such an array simultaneously concentrates the light incident on a diffractive element 
onto the active area of the sensor (using symmetrical X and Y fxusing powers or using anamorphic focusing power) 
5 while dispersing tfie light into its component colors and potentially providing a blurring function to act as an anti-aliasing 
device by allowing some undiffracted light from adjacent pixels to be incident on a nebby CCD element This will effec- 
tively blur the size of the spot. 

The diffraction efficiency of a given element can be controlled in a reproducible fashion by changing the surface 
proffle of the diffractive element For instance, using a tmary (square wave profile) grating causes 41% of the Gght to 

10 be diffracted into the ±1 diffraction orders while the rest is spread into other orders. A full diffractive blaze profile, such 
as disclosed in U.S. Patent AppOcation senal Na 175.708 filed Decerrtaer 29, 1993. entitied "Hybrid Refractive^iffrac- 
tive Achromatic Camera Lens', can achieve 100% diffraction efficiency at its design wavelength, although 95 to 98% 
efficiency is more readily achieved in practice. By varying the surface profile, the intensity distribution of the diffraction 
pattern can be modified to produce needy any dei^Yed bhirpattem to provide the anti-aliasing function. 

IS The above and otfier objects of the ipmesent invention wai become more apparent when taken in conjunction witti 
the follcMdng description and drawir^s wha-ein identical reference iumerais have been used, where possible, to desig- 
nate identi^ elements that are common to the figures. 

Advantageous Effect of the Invention 

20 

The use of an array of diffractive elernarts to disperse and concentrate tfie tight on a CCD an-ay while also providing 
an anti-aliasing function has several advauitages. Rrst it allows for an increase in the sensitivity of the CCD anay 
through the elimination of tfie light loss due to the absorption titers traditibnally used for color CCD arrays. The elimi- 
nation of the absorption f Oters also increases ttie manufacturing yieici of the CCD anay because there is no need to pat- 
^ tem tfie filter elem^ over the photdsensitiife elements. It also afiows for the concentration of light onto the active area 
of the detector rattier tiian allowing it to fail on tfie inactive areas between tfie photosensitive elements vwtfiout having 
. to form concentrating lenslets directiy on tfie CCD array Anotiier advantage of the diffractive element array is tfiat any 
aliasing will be invariant with color and will not produce color varying m^g patterns. A further aspidct of tfie diffractive 
array is that tfie undiffracted light from one pbcei of Incident light will provide a blurring function for otiier pixies in a fesh- 
,^"^$0 ion simiTar to that utilized in birefringent blur filters. All of tfiese features are obtained by atigning one array of diffractive 
elements at a given height over the detector array. 

: Brief Description of ttie Drawinos 

Fig. 1 illustrates ah arrangermnrt of the present jriventibn utilizing the inventive diffractive array; 

Rg. 2 illustrates the diffractive anay in a 

Fig. 3 is a perspectiye vim of a single row of the a^ 

Rgs. 4A and 4B are schetrtiatic iHustrafions of tfie dispersion of incident light from a single redanguteir diffractive 
dement and a perspective view of tfie surface profile of the diffractive element respectively; 

Flgsw 5A. 5B, and 5C, iilustfate the (X)iicentration of tfie Blue^ Green and Red. light as tfiey pass tfirough a single 
45 rectangular diff^ctive element 

Rg. 6 illustrates tfie dispersion oiF a white fight incident on tiie diffractive element into Red, Green and Blue spots. 
Rg. 7 is a chart illustrating tiie intensity distrbution of tfie Red. Green, and Blue, spots of Rg. 6; 

so 

Rg. 8 is a chart illi^ting tfie varation of angular separation between tfie Red and ttie Green light as a function 
of the angle of incidence; 

Rg. 9 is a chart illustrating tfie exit angle of tfie Red, Green, and Blue light as a function of tfie angle of inddence; 

55 ' 

Rg. 10 is an optical ray diagram illustrating tfie variation of tiie exiting angle across tfie CCD array as a function of 
the field angle; 

Fig. 1 1 is a chart illustrating tiie displacement of the chief ray in tfie Red, Green, and Blue witfi respect to the center 
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of the dtffractive element; and 

12A and 12B are graphs Olustroting ttie diffraction efficient as a function of wavelength for a diffractive fu- 
ture height of maximum effidency and a height of half of the maximum effiden^ hei^ 

5 

Detailed Description of the Indention 

Referring to Fig. 1, an image capturing lens 10 which may be part of image capturing device such as a camera or 
scanner focus^ light onto a diffractive array 20. The diffracted light from the array 20 is inddent onto an anay of pho- 
10 tosensitive elements such as a CCD array 40. In the preferred emi)odiment of the inv^ition the CCD array 40 is forrned 
as a grid of monochrome photosensitive elements 42 that receive primarfly, red, green, or blue Oght dependent on fheir 
displacement from the cemer of the diffractive anra^ 

: . Fig. 2 is a top view of the diffractive array 20 Illustrating an array of rectangular (fiffiractive elements 22. Each (fif- 
fractive element .22 is formed In a transnussive 8ut)strate such as quartz, optical glass or slTtoon dioxida Incorporated 
15 into each element is a pfuraGty of tilazed diffractive features 24 which are curved so as to focus and chnomaticalty ds- 
perse inddent light The shape of the diffractive features 24 Is Ixised on combining a Gnear grating term and diffractive 
focusing and aberration correcting terms. 

Fig. 3 is a perspective view of one row of the anay 20 providing a dearer view of the diffractive elements 22 and 
their <fiffractive features 24. 

so Fig. 4 provides an enlarged view of a cfiffractive eiemertt 22 illustrating the sepeiration of an inddent light into a con- 
tinuum of odors with the major colors of Interest l)eing Red. Green, and Blue, where the central wavelengths are shown 
in TABLE 2. The CCD array 40 of Rg. 2, is comprised of a plurafity of photosltes 42 which intercept the fight whose odor 
Is determined by the angular location of the photosensitive elements with respect to the difiiractive elements 22. Note 
that each of the photosensitive elatients differs In size dependent on its color assignment 

25 Rg& 5A. 5B. and 5C demonstrates the concentration of light for the Blue. Greea and Red wavelengths, respec- 
tively, by the diffractive element 22, In a direction perpendicular to the view[ in Rg. 4A to filustrate that the ligttt from the 
elements is substantially concentrated and not color dispersed as shown in Rg. 4A. 

: Rg. 6 illustrates the separation of three^discreet wavefengtiis, red. green, and blue, into the spots labeled Red, 
Green and Blue, respectively By controlling the dze of the photosdisitive detector material forming the photosensitive 

50 elements 42 to correspond to the size of its assigned spot an eff ident cdor detector is formed. For exarrple, the size of 
the photosensitive detector material positioned to receive ttie Red spot is substantiaDy larger than ttie size of tfie pho- 
tosensitive materia! assigned to receive the Blue spot 

Rg. 7 fllustrates way of an intensity proffle the separation and concentration of the Red, Green, and Blue ligfit 
as was shown in Rg. 6. The Blue light » spread over the smallest area, but is shown with the highest peak intensity 

35 while the Red light is shown spread over ttie largest area with the lowest peak intensity. To achieve substantially ttie 
same amount of power from the assigned photosensitive elements it is ok>vious that the element assigned to receive 
the Red light would have to have a larger area than ttie element assigned to receive the Blue light as ttie peak intensity 
provided by each ligfit spot is niversely proportional to ttie area. Also to be observed is tiiat ttie spacing between pho- 
tosensitive elements is adjusted to compensate for the variations of angular separation as a function of field angle 

40 (more deariy seen toy reference to Rg. 4^. 

More spedfically, referring to Rg. 8, the diart illustrates the angular separation, de. of Red and Gb'een light as a 
function of angle of: incidence, 0{. Rg. 4A indicates, by the dout)led arrowed line, the angular separation referred to as 
do. The spadng U between the Green and Red photosensitive elements 42 Is adjusted as a function of Oj. For exanple, 
the spadng U. will be larger for each associated Green and Red pair of photosensitive elements when ttie incident 

45 angle is small, 0^, and becomes smaller as tiie incidence angle approaches 1 7^ and increases as Oj approaches 35^. 
In a like manner, altiiough not shown in the chart of Rg. 8. ttie spadng between ttie Blue and ttie Green photosensitive 
elements varies as a function of the angle of inddence. However, one can condensate for the slight variation of angular 
separation by changing ttie frequency of ttie linear grating term (DF2 in Table 1) as a function of position aaoss ttie 
anay. 

so The chart of Rg. 9 illustrates that ttie angular separation between the Red, Green, and Blue light is approximately 
a constant, hcwever, the diffracted angle is neariy a linear function of the angle of inddence. The position of each pho- 
tosensitive element 42 on ttie CCD array 40 is adjusted to intercept its assigned odor. 

Rg. 10. in cor^unction witti ttie chart of Fig. 9. illustrates ttie variation in ttie dffracted angle as a function of ind- 
dence angle. More spedfically, fooising on the A lat>eled portion of the CCD anray 40 and its associated portion of the 

55 diffractive anray 20 it can be seen that ttie diffracted angle for Green light is -1 5^ and in the B labeled portion it is approx- 
imately 0^ and in C labeled portion the angle e approxiniatety 15^. This translates, physically, into positioning the pho- 
tosensitive elements 42 at sites ttiat wili insure a maximum absorption of the.light component of interest 

The graph of FHg. 11 , shows the displacement of ttie central ray of the Gb-een Ixindle of light as a function of field 
angle. This variation can be conpensated for by adjusting the spadng of ttie conresponding CCD photosensitive ele- 
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ments 42 or atiSustment can be made to the DF2 term of Table 1. 

The surface proffle 26 of each cfiffractive element 22:can be described as a phase function 

0(x,y)e£Kj*(x%y'") 

5 

where 

m oQ, 1,.10 
n = 0,1..10 

10 K^a Coeffk:iefTt for jth term in expansion (maximum j » 65) 

An example of a prefen;ed embodiment of an off-axis asymmetric diffractive element 22 is listed in the table below. 



TABLE 1 
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LENS DATA 


SURFACE 


THICKNESS 


AR RADIUS 


GLASS 


0 


I.OOOOe^ 




AIR 


1 


0.1 


0.01 


BK7 


2 


0 


0.01 


AIR 
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DIFR ORDER =1 


DESIGN X = 0.546070 














TERM 


VALUE 


COEFFICIENT OF 












DF2 


0.500000 


Y 




DF3 


-7.290407 






DF5 


^.403396 


Y2 




DF10 


96.111224 






DF12 


2.8744ei03 






DF14 


-29.089917 






DF21 


0.014915 


X6 




DF27 


0.063802 














3 


0.05 




AIR 


4 


IMAGE PLANE 







so 



TABLE 2 



ss 



WAVELENGTHS 


GREEN 


BLUE 


RED 


0.546070 


0.486130 


0.656270 
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Ihe diffractive element 22 is placed over an adjacent photosensitive site 42 (pixel area) and given a carrier frequency 
(linear grating term) and the corresponding focal length is calculated for a given height atxsve the CCD anray 40 and the 
desired concentration ratio. If desired, ttie focusing power can be Afferent in the x and y directions to alfow for various 
concentrating geometries corresponding to different pixel shapes. Anamorphic aspherfe terms can be used to correct 
for aberrations in the focused wavefront 

The fbcal lengtti of a diffraction element 22 is proportional to ttie wavelength of light being used and can be 
expressed as 

W«(X^)%. 

where 

Xc s central wavelength of tiie design 

X = wavelengtii of interest 

fc = fbcal length at tiie central wavelength 

The diffraction of a ray tfvough the center of ttie aperture of the diffracfive elemant 22 is controlled by ttie carrier fre- 
quency term. The diffraction angle of the central ray is calculated from the grating equation to be: 

sine X- sine fsna/d 

where 

m = diffraction order (0^1>t2,...) 

e{,ex 8 angles of incidence and exiting ray 

d s grating groiove spacing (ttiis term cain be related to ttie pidlynomial form of ttie phase expression (term 0F2)}. 

By adjusting the carrier frequency (^1 Al) and ttie spacing between the diffractive element 22 and the detector array 
40 one can control how much wavelength dispersion tfie grating imparts to ttie incident wavefront and where ttie central 
ray at the central wavelengtti ends up on ttie detector anay 40. The spatial carrier frequency of ttie diffractive elements 
22 can t>e varied across the array to compensate for ttie effect of ttie changing angle of Incidence across the detector 
anray. It can also be varied to allow the use of rows or columns of pixels which only have green and red separations, or 
green and blue separations to aRow for different resolutions at any given color. 

The spectral weighting of a given color is related to angular subtense of the |Mxel as seen from ttie diffractive ele- 
ment 22. It is also related to the fraction of the total poss33le area at a given angle which is occupied wHh active photo- 
detector sites. This area weighting can be used to tailor the relative spectral response in any given wavelengtti band. 
The widtti of an angular region for a given spectral band can be found from ttie expression for ttie angle of diffraction 
due to ttie canler frequency term (1/d) 

slnOy^ - sine ,^ ^ mX ^/d 
sine^ - sine q s mX2/d 
for a given angle of incidence, this reduces to 

sine XI - sine^a « r^X^'Xj)f6 

for a separation of ttie diffractive element 22 to detector element 42 of S, ttie widtti of ttie pixel on ttie detector array 40 
to subtend a spectral widtti of AX » X ^ -X 2 along ttie direction of ttie spectral dispersion Is given by 

x« S^Oane^t -tane^a). 

for a block of wavelengttis (X1-X2). 

The concentration function is performed by imparting focusing power to the diffractive elerhent The focusing power 
is related to terms proportional to r^ in ttie diffractive phase polynomial. From the phase polynomial one can see ttiere 
are x^ and y^ terms for tiie x and y directions (see Table 1). Therefore, ttie fllumination concentration function can be 
performed to different degrees for ttie x direction (see Figs. 5A. 5B, and 5C)and ttie y direction (see Rg. 4A). Since ttie 
diffifactive element Is off-axis in one direction and on-axis in the ottier direction the asymmetric a^heric phase tem^ 
can be adjusted to correct for different magnitudes of aberrations In ttie different directions. 
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The diffractipn effictency of a diffractive efement 22 is a ^ng function of the shape and height of the diffractive 
element. For a first order diffractive surface the diffraction efficiency is given by 



il(X)«8inc%-m) 



where 



m a diffraction order 

a « wavelength detuning parameter 



and 



^ max = n^*>'0^("o""') - peak height of the diffractive groove 

The maximum effKaency of a first order diffractive surface is 100% at the central wavelength. However the effl- 
aency falls off as the wavelength is detuned from the central wavelength (see Fig. 12A). Therefore, there is always 
some undiffracted light with a first order dffractive surface. By changing the shape of the diffractive suifece or by chang- 
ing the height of the diffractive surface (see Fig. 12B) the efficiency of the diffractive suifece can be tailored to allow a 
desired fraction of the Incident light to be uncfiffiracted which wf U allow for the blurring of the focused spot which will alve 
the diffractive array an anti-aliasing property. 

The invention has been descra^ed wHh reference to preferred en*odiments. However, it will be appreciated that 
variations and nxxfrfications can be effected by a person of ordinary sfdil in the art without departing fonn the scooe of 
the invention. *^ 

Parts List 

10 image capturing lens . 

20 diffractive array 

22 diffractive element 

24 diffractive feature 

26 surface prof He 

40 CCDanay 

42 photosensitive elements 

Claims 



1. A cfiffractive element having at least one surface formed as a plurality of blazed diffractive features that are curved 
and decentered so as to focus and diromatically dispense incident light 

2. The diffractive element according to daim 1 wherein said diffractive features are asymmetrically shaped. 

3. A diffractive element comprising a rectangular body member formed of optically transparent materials, a plurality 
of cun^ed, blazed, asymmetric, diffractive features fomied in a surface of the optically transparent material so as to 
focus and chromatically disperse incident light. 

4. Adiffractiveelemertoomprisinganopticallytransparertrectengula^ asymmet- 
ric diffractive features positioned substantially parallel on a surface of said rectangular body so as to focus and 

chromatically disperse incident light 

5. A diffractive optical array for color separating incident light incorporating a plurality of rectangular diffractive ele- 
ments each having a pluraTity of asymmetric color dispersive facets. 



6. The diffractive optical array according to Claim 5 wherein the color dispersive facets incorporate in their design a 
linear grating term and diffractive focusing and aberration correction terms. 
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7. the diffiBCtive optical array aoconcfihg to Claim 5 wherein the color dispersive facets incorporate In th^r design a 
Gnear grating term and diffractrve focusing and at)erration correction terms which can be described bf. 

♦(x.y)«IKj*(x"+y'^ 

5 

Where 

m«0, 1..10 
n = 0.1..10 

10 1^ B Coefficient for jth term in expansion (maximum j « 65). 

8. A color sensor comprising: 

diffractive element having at least one surface formed as a plurality of blazed diffradive features that are 
15 curved and decentered so as to focus ardchromatioany disperse indderit fight: £^ 

a plurality of photosensitive elements positioned and sized to receive associated oomponents of the chromat- 
ically dispersed incident light 

9. The color sensor according to daim 8 wherein the incklent light is chromatically dispersed into spots of Red, Green. 
20 and Blue light and at least one photosensitive elemerit Is positioned to receive a sp^ 

10. A color sensor array comprising: 

ah anrsy of diffractive elements having at least one surfoce formed as a plurality of t)lazed cRffraclivB features 
2s . that are curved and decentered so as to focus and chromatically disperse incident light: and 

an imriy of photosensitive elements positioned to sense the focused and disper 
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Fig. 2 



INCIDENT LIGHT 




Fig. 3 
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Fig. 9 
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